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BACKGROUND OF THE INVENTION 

10 

Field of the Invention 

The field of the invention is data processing, or, more specifically, methods, systems, 
and products for controlling a GUI display for a plug-in. 

15 

Description Of Related Art 

Many software infrastructures allow customers to write custom pluggable software 
20 components ("plug-ins") to meet their individual software needs. If a single static 
graphical user interface ("GUI") manages the software system, plug-ins are not able 
to use the product's GUI because such GUIs do not extend interfaces through 
applications so as to make GUI functions accessible to plug-ins. GUIs often do not 
extend interfaces through applications so as to make GUI functions accessible to 
25 plug-ins because an application supporting plug-ins often has a proprietary look and 
fell effected through its GUI, a proprietary look and feel that may be the subject of 
considerable investment on the part of its developer. Some applications support plug- 
ins with text-based configuration files or even hard code configuration parameters, 
requiring recompilation of the application in order to incorporate a plug-in. Other 
30 applications use web services portlets to support GUIs, requiring development of 
separate GUI functions for the plug-ins. Both these approaches risk GUI style 
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differences from the supporting application because they both put full GUI control in 
the hands of the plug-in. GUI styles in plug-ins that differ from the GUI style of a 
supporting application are undesirable because the hosting parent supporting 
application may lose control of the overall look and feel of its GUI presentation to 
5 users. 

SUMMARY OF THE INVENTION 

Methods, systems, and products are disclosed to provide GUI extensibility into an 
10 application supporting plug-ins so that a plug-in developer can use GUI functions 
whose operations may be controlled by the application so as to maintain the 
consistent look and feel of a particular application. More particularly, methods, 
systems, and computer program products are provided for controlling a GUI display 
for a plug-in in an application supporting plug-ins. Embodiments include receiving, 
1 5 at run time, in the application from the plug-in a request to display a GUI object; 
responsive to the request, retrieving an XML representation of the GUI object; and 
displaying the GUI object in dependence upon the retrieved XML representation of 
the GUI object. Typical embodiments also include receiving from the plug-in a 
request to retrieve user input responsive to the GUI object; and retuming to the plug- 
20 in responsive user input. 

Typical embodiments of the invention also include installing the plug-in in the 
application, including configuring the application with the location of at least one 
XML representation of at least one GUI object. Typical embodiments also include 

25 providing through the application for the plug-in access to a subset of a set of GUI 
objects supported by a GUI environment. Many embodiments include providing GUI 
functions for the plug-in through a GUI API in the application, wherein receiving, at 
run time, in the application from the plug-in a request for display of a GUI object 
includes receiving a GUI API call from the plug-in. Typical embodiments include 

30 parsing the retrieved representation of the GUI object, wherein displaying the GUI 
object include displaying the GUI object in dependence upon the parsed 
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representation of the GUI object. Typical embodiments also include publishing XML 
syntax for representing XML GUI objects operable by a plug-in through the 
application. 

5 The foregoing and other objects, features and advantages of the invention will be 
apparent from the following more particular descriptions of exemplary embodiments 
of the invention as illustrated in the accompanying drawings wherein like reference 
numbers generally represent like parts of exemplary embodiments of the invention. 

10 BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 sets forth a block diagram of automated computing machinery useful in 
controlling a GUI display for a plug-in in an application supporting plug-ins 
according to embodiments of the present invention. 

15 

Figure 2 depicts a graphical user interface ("GUI") running an exemplary browser. 

Figure 3 sets forth a block diagram illustrating an exemplary system for controlling a 
GUI display for a plug-in in an application supporting plug-ins. 

20 

Figure 4 sets forth a block diagram illustrating an exemplary system architecture, 
useful in various embodiments of the present invention for controlling a GUI display 
for a plug-in in an application supporting plug-ins. 

25 Figure 5 sets forth a flow chart illustrating an exemplary method for controlling a 
GUI display for a plug-in in an application supporting plug-ins. 
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DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS 



Introduction 

5 The present invention is described to a large extent in this specification in terms of 
methods for controlling a GUI display for a plug-in. Persons skilled in the art, 
however, will recognize that any computer system that includes suitable 
programming means for operating in accordance with the disclosed methods also falls 
well within the scope of the present invention. Suitable progranmiing means include 

10 any means for directing a computer system to execute the steps of the method of the 
invention, including for example, systems comprised of processing units and 
arithmetic-logic circuits coupled to computer memory, which systems have the 
capability of storing in computer memory, which computer memory includes 
electronic circuits configured to store data and program instructions, programmed 

1 5 steps of the method of the invention for execution by a processing unit. 

The invention also may be embodied in a computer program product, such as a 
diskette or other recording medium, for use with any suitable data processing system. 
Embodiments of a computer program product may be implemented by use of any 

20 recording medium for machine-readable information, including magnetic media, 

optical media, transmission media, or other suitable media. Persons skilled in the art 
will immediately recognize that any computer system having suitable progranuning 
means will be capable of executing the steps of the method of the invention as 
embodied in a program product. Persons skilled in the art will recognize immediately 

25 that, although most of the exemplary embodiments described in this specification are 
oriented to software installed and executing on computer hardware, nevertheless, 
alternative embodiments implemented as firmware or as hardware are well within the 
scope of the present invention. 
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Controlling a GUI Display for a Plug-in 

Methods, systems, and computer program products for controlling a GUI display for a 
plug-in in an application supporting plug-ins are described with reference to the 
5 drawings beginning with Figure 1 . Figure 1 sets forth a block diagram of automated 
computing machinery represented as a computer (134) useful in controlling a GUI 
display for a plug-in in an application supporting plug-ins according to embodiments 
of the present invention. The computer (134) of Figure 1 includes at least one 
computer processor (156) or *CPU' as well as random access memory (168) 
10 ("RAM"). Stored in RAM (168) is an application program (152) and a plug-in (104). 
Application programs include particular computer software instructions for 
controlling a GUI display for a plug-in in accordance with embodiments of the 
present invention. A plug-in hardware or software module typically adds a specific 
feature or service to an application. 

15 

The application (102) of Figure 1 operates generally by receiving, at run time, from 
the plug-in a request to display a GUI object; retrieving an XML representation of the 
GUI object; and displaying the GUI object in dependence upon the retrieved XML 
representation of the GUI object. In the example of Figure 1 , the application ( 1 02) 

20 has standards of appearance for its GUI display, and the application ( 1 02) may 

operate in computer (134) by retrieving an XML representation of a GUI object that 
complies with the application's standards of appearance for the GUI display. By 
having standards of appearance and retrieving for requesting plug-ins XML 
representations of GUI objects that comply with the application's standards of 

25 appearance, application (102) maintains control of the overall look and feel of its GUI 
presentation to users. Any application may support a plug-in. Examples of 
applications that often support plug-ins are email clients such as Microsoft OutlookyM 
and browsers such as Microsoft Internet ExplorerxM. Popular plug-ins for Internet 
Explorer include, for example: the FlashrM plug-in from Macromedia, Inc.; the 

30 QuickTime™ plug-in from Apple Computer, Inc., and the RealPlayerjM plug-in from 
RealNetworks, Inc. 
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Also stored in RAM (168) is an operating system (154). Operating systems useful in 
computers according to embodiments of the present invention include Unix, Linux, 
Microsoft NTtm, and many others as will occur to those of skill in the art. As 
discussed in more detail below, operating system (154) includes GUI functions (116) 
5 operable through an application programming interface ("API") provided by the 
operating system. 

The computer (134) of Figure 1 includes computer memory (166) coupled through a 
system bus (160) to processor (156) and to other components of the computer. 
1 0 Computer memory ( 1 66) may be implemented as a hard disk drive ( 1 70), optical disk 
drive (172), electrically erasable programmable read-only memory space (so-called 
*EEPROM' or 'Flash' memory) (1 74), RAM drives (not shown), or as any other kind 
of computer memory as will occur to those of skill in the art. 

15 The example computer (134) of Figure 1 includes a communications adapter (167) for 
implementing connections for data communications (184), including connection 
through networks, to other computers (182), servers, clients, administrative devices, 
or sleeping devices. Communications adapters implement the hardware level of 
connections for data conmiunications through which local devices and remote devices 

20 or servers send data communications directly to one another and through networks. 
Examples of communications adapters include modems for wired dial-up 
connections, Ethernet (IEEE 802.3) adapters for wired LAN connections, and 
802.1 lb adapters for wireless LAN connections. 

25 The example computer of Figure 1 includes one or more input/output interface 

adapters (178). Input/output interface adapters in computers implement user-oriented 
input/output through, for example, software drivers and computer hardware such as 
graphics adapters for controlling output to display devices (180) such as computer 
display screens, as well as user input from user input devices (181) such as keyboards 

30 and mice. GUI functions (116) operate graphics adapters to provide GUI 
environments for applications and plug-ins. 
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The term "GUI object" is used in this specification as a generic term for a part of a 
GUI that allows the user to interface with the application and operating system. GUI 
objects display information and support user interaction with the GUI. Examples of 
5 GUI objects include buttons, dialog boxes, pop-up windows, pull-down menus, icons, 
scroll bars, resizable window edges, progress indicators, selection boxes, windows, 
tear-off menus, menu bars, toggle switches, forms and other GUI objects that will 
occur to those of skill in the art. For further explanation of GUI objects, refer to 
Figure 2 which depicts a graphical user interface ("GUI") on a local host running an 

10 exemplary data communication application, more particularly, in the example of 
Figure 2, a browser. The browser of Figure 2 includes a GUI toolbar (718) with a 
Back button, a Forward button, and buttons for refreshing the display, searching, 
printing, and stopping web page retrievals, each of which is a GUI object. The 
browser of Figure 2 also includes a horizontal menu (716) containing the menu items 

15 File, Edit, View, Bookmark (called 'Favorites' on some browsers). Tools, and Help. 
The horizontal menu (716) is a GUI object and each of the menu items is also a GUI 
object. The browser of Figure 2, as depicted, has been operated to point to a web site 
named "SomeSearchEngine.com," as shown in the title bar of the browser display 
(714). The title bar is the title bar for a GUI window. The GUI window is a GUI 

20 object and the title bar is a GUI object. 

Figure 3 sets forth a block diagram illustrating an exemplary system for controlling a 
GUI display (126) for a plug-in (104) in an application (102) supporting plug-ins. 
The exemplary system of Figure 3 a plug-in installed in the application, by 

25 configuring (140) the application with the location of the software components of the 
plug-in and the location of at least one XML representation (130) of at least one GUI 
object. Although Figure 3 depicts only one XML representation, GUI objects 
include further GUI objects and the XML representation of such a GUI object may 
include XML representations of the fiirther GUI objects. XML representations of 

30 GUI objects include XML representations of attributes and elements of GUI objects. 
The configuration (140) and the XML representation (130) are depicted in Figure 3 as 
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located in a file system (128). The exemplary plug-in of Figure 3 is shown within the 
application (102). 

The locations within the computer system of the application configuration data (140), 
5 the XML representation (130) of GUI objects, and the plug-in (104) are not 

limitations of the invention. The file system (128), the configuration data (140), the 
XML representation (130), and the plug- in (104) can be located anywhere in 
cyberspace that can be located with a Universal Resource Locator ("URL"). Some 
applications, for example, expose an API for GUI functions through a web services 
10 portlet, and in such systems a plug-in may execute on another computer located 
remotely across a network firom the computer the application is on. 

Figure 4 sets forth a block diagram illustrating an exemplary system architecture, 
useful in various embodiments of the present invention for controlling a GUI display 

15 (126) for a plug-in ( 1 04) in an application ( 1 02) supporting plug-ins, in which a 

configuration file (140) for an application is stored on a file system (128) local to the 
application, and a plug-in (104) and an XML representation (130) of GUI objects for 
the plug-in are located on a remote file system connected to the application through 
network (404). In the example of Figure 4, the locations of plug-in (104) and XML 

20 representation (130) are configured for the application as URLs (not shown) listed in 
the application's configuration file (140). 

Figure 3 and Figure 4 illustrated two exemplary architectural arrangements for 
locating plug-ins and associated XML representations of GUI objects with respect to 
25 the locations of applications. Other architectural arrangements for controlling a GUI 
display (126) for a plug-in (104) in an appHcation (102) supporting plug-ins will 
occur to those of skill in the art, and all such architectures are well within the scope of 
the present invention. 

30 Both of the exemplary systems of Figures 3 and 4 operate generally by receiving, at 
run time, in the application firom the plug-in a request to display a GUI object; 
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retrieving an XML representation (130) of the GUI object in response to the request; 
and displaying the GUI object in dependence upon the retrieved XML representation 
of the GUI object. In both of the illustrated exemplary systems of Figures 3 and 4, 
application (102) has standards of appearance (312) for its GUI display (126), and 
5 retrieving an XML representation ( 1 30) of the GUI object is carried out by retrieving 
an XML representation (130) of the GUI object that complies with the application's 
standards of appearance (312) for the GUI display (126). By having standards of 
appearance and retrieving for requesting plug-ins XML representations of GUI 
objects that comply with the application's standards of appearance (312), application 
10 (102) in the system of Figure 3 and in the system of Figure 4 maintains control of the 
overall look and feel of its GUI presentation to users. 



The application (102) of Figure 3 includes a plug-in display engine (106). The plug- 
in display engine (106) includes GUI functions (110). A GUI function is a software 

15 routine that displays and administers GUI objects, displaying GUI objects on displays 
(126) operated through GUI adapters (124) and adapter drivers (120) and retrieving 
user input (132) through input adapters (136) such as, for example, mouse adapters 
and keyboard adapters operated by input adapter drivers (138). The plug-in display 
engine (106) exposes an API (112) for the plug-in (104) to use in accessing the GUI 

20 functions (110). The plug-in display engine also includes rules (108) governing the 
scope of the GUI functionality that is made accessible to the plug-in (104). Examples 
of rules (108) governing the scope of the GUI functionality that is made accessible to 
the plug-in (104) include: 



25 o a plug-in may display tool bar widgets only 

o a plug-in may display GUI objects only in a predefined area of a display 
screen 

o a plug-in may display GUI objects using a predefined set of colors. 
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The plug-in display engine (106) of Figure 3 operates generally by providing through 
the application (102) for the plug-in (104) access to a subset of a set of GUI objects 
supported by a GUI environment. In the example of Figure 3, an overall GUI 
environment is provided by an operating system (118) which provides GUI functions 
5 (116). The GUI functions ( 1 1 6) of the operating system (1 1 8) are accessible to the 
application (102) through an API (122) exposed to the application by the operating 
system (118). Subject to the rules (108), the plug-in display engine (106) provides 
through its GUI functions (110) all or a portion of the GUI functions (1 16) of the 
overall GUI environment. While in the example of Figure 3, the operating system 
10 (118) provides the overall GUI environment for the application (102), this is not a 
limitation of the scope of the invention. GUI environments may be provided by 
applications, as a toolset at the application level outside the operating system or any 
other application, and otherwise as will occur to those of skill in the art. 

1 5 As just mentioned above, the plug-in display engine of Figure 3 ( 1 06) provides 
through its GUI functions (110) all or a portion of the GUI functions (1 16) of the 
overall GUI environment. Because a plug-in display engine may not support all the 
GUI functions of a particular GUI environment like a particular operating system for 
example, developers of applications that support plug-ins according to the present 

20 invention can publish a list of GUI objects supported by the application, the list 
comprising a subset of the set of GUI objects supported by a GUI environment. A 
list of supported GUI objects advantageously allows plug-in developers to write plug- 
ins for applications that support plug-in according to embodiments of the present 
invention. Developers of applications supporting plug-ins may advantageously 

25 publish XML syntax for representing XML GUI objects operable by a plug-in 

through the application. Exemplary ways of publishing XML syntax for representing 
XML GUI objects include XML Document Type Definitions ("DTDs") and XML 
schema. Such a DTD or schema may be published by storing the DTD or schema at a 
location in cyberspace, such as, for example, a location identified by a URL such as: 

30 http://www.gui.obj/guiObjects/syntax.dtd. Then, when a DTD named "syntax.dtd" is 
stored at the location identified by that URL, any XML document can use that DTD 

10 
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to determine syntax for representing GUI object by including these declarations in the 
XML document, for example: 

<?xml version="1.0"?> 
5 <!DOCTYPE guiObjects SYSTEM 

"http://www.gui.obj7guiObjects/syntax.dtd"> 

The exemplary system of Figure 3 operates generally by providing GUI functions 
(110) for the plug-in (104) through a GUI API (1 12) in the application (102). At run 

1 0 time, the plug-in requests display of GUI objects by calling GUI functions through 
the API (112). The plug-in display engine (106) receives requests for display of GUI 
objects as GUI API calls from the plug-in (104). In response to requests for display 
of GUI objects, the plug-in display engine (106) of Figure 3 retrieves XML 
representations (130) of the GUI objects from a file system (128) and displays the 

1 5 GUI objects in dependence upon the retrieved XML representations by calling GUI 
functions (1 16) in the operating system (118) through an API (122). In the example 
of Figure 3, the GUI functions (1 16) display the GUI objects through a driver (120) 
and an adapter (124). 

20 In the example of Figure 3, the plug-in display engine also receives from the plug-in 
(104) requests to retrieve user input (132) responsive to displayed GUI objects. 
Requests to retrieve user input may be implemented synchronously as blocking calls 
that wait for user input. Alternatively, requests to retrieve user input may be 
implemented as calls that register the plug-in or a software object in the plug-in as a 

25 listener with the plug-in display engine ( 1 06). The plug-in display engine (1 06) 
returns to the plug-in responsive user input made available to the plug-in display 
engine through an adapter (136), driver (138) and GUI functions (1 16) in the 
operating system. 

30 Figure 5 sets forth a flow chart illustrating an exemplary method for controlling a 
GUI display (126) for a plug-in (104) in an application (102) supporting plug-ins that 



11 



AUS920040011US1 



Patent Application 



includes receiving (302), at run time, in the application from the plug-in a request to 
display a GUI object and retrieving (304) an XML representation (130) of the GUI 
object in response to the request. In the example of Figure 5, the application (102) 
has standards of appearance (312) for the GUI display, and retrieving an XML 
5 representation of the GUI object is carried out by retrieving an XML representation of 
the GUI object that complies with the application's standards of appearance (312) for 
the GUI display (126). By having standards of appearance and retrieving for 
requesting plug-ins XML representations of GUI objects that comply with the 
application's standards of appearance (312), application (102) maintains control of 
10 the overall look and feel of its GUI presentation to users. 



The method of Figure 5 also includes parsing the retrieved representation of the GUI 
object, where displaying the GUI object further comprises displaying the GUI object 
in dependence upon the parsed representation of the GUI object. Here is an example 
15 of an XML representation of GUI objects: 



<window title="MyWindow" location="0,0" size= "200,300"> 
<dialogBox displayText= "Display Something?> 
<button type=YesButton /> 
20 <button type=NoButton /> 

</dialogBox> 
</window> 



This example describes a window entitled "MyWindow" configured to display in the 
25 top left area of a display screen sized at 200 by 300 pixels. The window is 

represented to contain a dialogue box that will display the text "Display Something?" 

The dialogue box is represented to contain two buttons, a Yes button and a No button. 

The method of Figure 5 also includes displaying (306) the GUI object in dependence 

upon the retrieved XML representation of the GUI object. A plug-in display engine 
30 is unlikely to operate directly against XML in text form, however. The exemplary 

XML representation of a window may therefore be parsed, for example, into the 
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following structure expressed, for example, in C, C++, or Java: 



struct GUI_STRUCTURE 
{ 

5 TypeCode type = WINDOW; 

string title = "MyWindow"; 
int locationX = 0; 
int location Y = 0 
int sizeX = 200; 
10 int sizeY = 300; 

struct 
{ 

TypeCode type - DIALOGUE BOX; 
string displayText = "Display Something?"; 
15 struct 

{ 

TypeCode type = YES_BlJTTON; 

} 

struct 

20 { 

TypeCode type = NO_BUTTON; 

} 

} 



25 



}; 



The method of Figure 5 also includes receiving (308) from the plug-in (104) a request 
to retrieve user input responsive to the GUI object and returning (310) to the plug-in 
responsive user input. In the GUI window described above, for example, user input 
may select or operate one of the buttons to display something or refrain from 
30 displaying something. 
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In view of these descriptions of exemplary embodiments, readers will recognize that 
embodiments of the present invention advantageously provide GUI extensibility into 
an application supporting plug-ins so that a plug-in developer can use GUI functions 
whose operations may be controlled by the application so as to maintain the 
consistent look and feel of an application. It will be understood from the foregoing 
description that modifications and changes may be made in various embodiments of 
the present invention without departing from its true spirit. The descriptions in this 
specification are for purposes of illustration only and are not to be construed in a 
limiting sense. The scope of the present invention is limited only by the language of 
the following claims. 
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